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Abstract 

Recent developments in models with warped extra dimensions have opened new possibilities 
for vector-like quark studies at hadron colliders. These new vector-like quarks can mix sizably 
with light Standard Model quarks without violating low energy constraints. We perform a model- 
independent analysis to determine the Tevatron reach in the search for new quarks. We find that 
the Tevatron has great potential to observe such quarks via their electroweak single production 
due to their mixing with valence quarks. With 4 (8) fb _1 integrated luminosity, one may reach a 
5cr statistical significance for a heavy quark of mass 580 (630) GeV if the heavy quark-Standard 
Model quark mixing parameter is order one. 
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I. INTRODUCTION 



The discovery of the top quark at the Fermilab Tevatron completed the three generations 
of fermions as the fundamental structure of matter fields in the Standard Model (SM). With 
the large data sample being accumulated, the CDF and DO experiments at the Tevatron are 
in a good position to search for heavier states at the high energy frontier. New vector-like 
quarks with sizable couplings to the SM quarks are a well-motivated extension of the SM, 
as they naturally appear in many theories beyond the SM. 

Due to the precision with which the couplings of light quarks have been measured, new 
vector-like quarks are typically allowed to mix sizably only with the third generation, mainly 
with the top quark. However, there can be cases in which corrections to the couplings of the 
SM quarks due to their mixing with heavy quarks can cancel, leaving no observable trace 
of the existence of heavy quarks in SM interactions [l||. The simplest possibility, that we 
discuss in detail in the Appendix, is to introduce two degenerate doublets, with hypercharges 
7/6 and 1/6, that only have Yukawa mixing with ur [2J, in the basis of diagonal Yukawa 
couplings in the up-type quark sector. This also ensures that flavor constraints are satisfied. 
Such scenarios can occur naturally in models with warped extra dimensions with custodial 
protection of the Zbb coupling 0] . The relevant part of the Lagrangian reads, 

+ \ Q {Qfv + Xf v )uf + m Q {Qf Q f + X$>X® ) + h.c] , (1) 

where we have only explicitly written the up quark for the SM sector with electric charge 
2/3, Ck = Tpipip is the sum of the diagonal kinetic terms (with covariant derivatives, thus 
including gauge couplings) for all the fields in the theory, % = 1, 2, 3 are family indices, V U i 
is the first line of a unitary matrix (the CKM matrix in the absence of new physics), ip is 
the SM Higgs field and (p = ia 2 <p*. The superscript (0) denotes that the fields are not mass 
eigenstates and X^ R and Q^ R are the two new vector-like doublets with hypercharges 7/6 
and 1/6, respectively. 

The couplings in the physical basis can be easily computed, as discussed in the Appendix. 
The result is that the corrections to the gauge couplings of the SM quarks are negligible. 
There are four new heavy quarks in the spectrum: one with electric charge —1/3, one 
with electric charge 5/3 and two with electric charge 2/3. The phenomenologically relevant 
couplings of the new heavy quarks with the SM quarks are listed in Table [J in the limit 
v <C mQ, where ttiq is the heavy quark mass, v = 174 GeV is the SM Higgs vacuum 
expectation value, g is the weak coupling constant and c w is the cosine of the weak angle. 
All the other couplings of these new quarks to the SM quarks are extremely suppressed and 
therefore irrelevant. More interestingly in the models with extra dimensions that motivated 
our study, Xq can be naturally order one. This large coupling, together with very distinctive 
kinematics, makes single production of a heavy quark an ideal process for its discovery. 

Motivated by the above set up we investigate the potential of the Tevatron to find new 
quarks and perform a model-independent analysis as described below. Let us consider two 
new quarks, U and D, with masses mu,D and electric charges Qu = 2/3 and Qo = —1/3, 
respectively. Based on the discussion above, we assume they do not induce anomalous 
couplings among the SM quarks and they have the following charged current (CC) and 
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q + 


q d 




Electric Charge 
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2/3 


-1/3 
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Coupling to ur 


CC 
NC 
Yukawa 


-a v \ _ 

V2c w m Q Q 


V2Xq 


-g f \ 


— — An 



TABLE I: Couplings of new heavy quarks to SM up- type quark in the limit v <C rriQ, where rriQ 
is the heavy quark mass, v = 174 GeV is the SM Higgs vacuum expectation value, g is the weak 
coupling constant and c w is the cosine of the weak angle. 



neutral current (NC) gauge interactions to the first generation quarks, 

-^=W+(k uD un-fDa + Kju d R -fU R ) + -^—Z^k^j urYUr + ^d d R -fD R ) +h.c. (2) 
V2 M 2c w 

The coupling strength is parameterized by K q g in a model-independent manner as 

K qQ = {v/m Q )k qQ , (3) 

where the dimensionless parameter k q g encodes the model-dependence. Thus, the relevant 
couplings in the model we have discussed, in the limit, uiq 3> v are the ones in Eq. (j5J), with 
k u jj ~ — V2Xq and k uD — Aq. Note, however, that our parameterization is completely 
model-independent and it still includes the case of lighter ttiq. A similar model with two 
doublets of hypercharges 1/6 and —5/6 that mix only with the d R quark will generate 
the other two couplings in Eq. (J2J). We have not explicitly written down the heavy quark 
Higgs couplings because they do not contribute appreciably to the production process of our 
interest. For the purpose of decay properties of heavy quarks the coupling of fermions with 
Higgs can be reabsorbed in the definition of decay branching ratios that we will leave as a 
free parameter in our analysis. Also, the extra quarks with exotic charges (5/3 or —4/3) 
can be trivially included by multiplying the corresponding production cross section by the 
appropriate number of quarks. In Eq. ([2]) we have only written down right-handed (RH) 
couplings, which appear in the case of vector-like doublets. Left-handed (LH) couplings will 
appear in the case of vector-like singlets. Since we will not make use of angular correlations, 
our results do not depend on the choice of the chiral couplings appreciably. 



II. HEAVY QUARK PRODUCTION 

Heavy quarks can be produced in pairs via strong QCD interactions 

QQ, 99 -> QQ- (4) 

Alternatively, a heavy quark can also be produced singly via the weak interactions as in 
Eq. © 

QQ' — > QiQ, (5) 

where V = W or Z gauge boson. The production cross sections for these processes are 
shown in Fig. [1] at the Tevatron energy (y/s = 1.96 TeV) versus the heavy quark mass 
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m Q (GeV) 

FIG. 1: Total cross sections for heavy quark production versus its mass m.Q at the Tevatron with 
y/s = 1.96 TeV in pp collisions. Solid curves are for single production via charged current (CC) 
of D + D (upper) and U + U (lower); dashed curves are for single production via neutral current 
(NC) ofU + U (upper) and D + D (lower); and the dotted curve is for pair production from QCD. 



tuq, where the NLO corrections to the total cross section with respect to our tree- level 
results (the K factor) have been taken into account as K ~ 1.5 for pair production 
and K « 0.96 for single production (1). The pair production (dotted curve) is completely 
dominated by valence quark annihilation. The current bound from direct searches at the 
Tevatron experiments is ttiq > 284 (270) GeV at 95% CL. for heavy up (down) type quarks 
decaying via CC (NC) [6]. This is unlikely to improve dramatically as the cross section 
falls off sharply due to phase space suppression and decreasing parton luminosity at large x 
values. 

On the other hand, single heavy quark production has the advantage of less phase space 
suppression and longitudinal gauge boson enhancement of order trig/My at higher energies. 
Due to the participation of u, d valence quarks in the initial state with the coupling strength 
given in Eq. (j2J), the cross section can be substantial and it falls more slowly for a higher mass. 
For a model-independent presentation, the coupling parameters, generically denoted by k, 
have been factored out. The full leading-order matrix elements for q'q — > qiQ — ► q^ff with 
qW* and qZ* fusion have been calculated using helicity amplitudes and cross-checked against 
other available packages. For instance, for a mass as heavy as 600 GeV, with R, ~ 1, the cross 
section is of the order of 100 fb for each new quark. Their relative sizes are determined by the 
corresponding valence quark density in the initial state. In our analysis we use CTEQ6L1 
parton distribution functions 0] and choose the factorization scale, fip = M W ,M Z for the 
signal 0. For the background, we choose the factorization and renormalization scales to be 

= Vr = y/l/2. 
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0.OZ 


single top: W b j 


330 


10 


2.9 


ti: fully leptonic 


170 (79) 


2.0 


0.40 


ti: semi-leptonic 


600 


0.19 





TABLE II: Total cross-sections (in fb) for the signal with mq = 400 GeV and Sq° = 1 and the 
leading SM backgrounds at the Tevatron before and after the kinematical cuts in steps described 
in the text. D + D and U + U and the leptons £ = e, fx have been counted for. For ti, the numbers 
in parentheses in the second column include a veto on events with two isolated leptons. 



III. HEAVY QUARK DECAY 

The singly produced heavy quarks will decay into jets and gauge or Higgs bosons through 
gauge and Yukawa interactions. The allowed channels are 

D -> W'u, Zd, hd, U -> W + d, Zu, hu. (6) 

For the remainder of this work we will concentrate on the gauge boson channels. To per- 
form a model-independent study, we parameterize the cross section under the narrow-width 
approximation as 

°(PP - = aZT Br{V - //), (7) 

where o"^ ( j^ C) is only dependent on the cm. energy and mass of the heavy quark and Sq C{NC) 
encode the model-dependent parameters and are denned as 

S C D ° = (~K 2 uD + a c D c K 2 dD ) Br(D^qW), 

ee {k 2 dU + a c v c R 2 uU ) Br{U^qW), 
S»° = (H 2 dD + < c hl D ) Br(D^qZ), 

= (K 2 uU + a™ n 2 dU ) Br(U^qZ), (8) 

where a c Q c = a^ r c od J a^ odn and a£ c = a^ od J a^ odn are the ratios of the production cross 
section of the heavy quark via CC and NC and can be deduced from Fig. [IJ In the case 
of degenerate bidoublets, only one gauge boson decay mode is available for each new quark 
and Br[Q -> qW(Z)] is 100%. For instance, if Br[D -> uW] = Br[U -»■ uZ] = 100%, then 

CCC _ £2 J CNC _ r-2 

°D — K uD dI1U °U — K uU' 
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TABLE III: Same as in Table ILT1 but with Sq C = 1. The numbers in parentheses in the second 
column include a veto on events with missing energy. See text for details. 



channels 


Basic cuts (fTUj) 


High p T 


m Q (H2D 


D -> Z{-^ vv)q 


31 


22 


18 


U -> Z(-> vv)q 


79 


56 


46 
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Z(-> 2j) 
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tt: fully leptonic 
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0.89 
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1.1 



TABLE IV: Same as in Table ILH1 but with £ = e,fi and v = v e , u^, u T . The numbers in parentheses 
in the second column include a veto on events with isolated leptons. 



IV. OBSERVABILITY OF THE HEAVY QUARK SIGNAL 

For the signal identification, we also require the clean leptonic decay modes of the gauge 
boson with £ = e, /i and v = u e , u^, v T . Although the inclusion of r lepton in the final 
state could increase the signal statistics, for simplicity we ignore this experimentally more 
challenging channel. Focusing on the single heavy quark production, the three channels of 
the final states under consideration are 

£ ± fi T 2j, £ + l~2j, fir2j, (9) 

from Q decaying to a W(— > £ v) and Z(— > £ + £~ , uu), respectively. We perform a partonic 
analysis and simulate the detector resolution by smearing the energies of the leptons and 



jets by the Gaussian form according to AEe/Ee = 0.135/ y/Ee/GeV © 0.02 and AEj/Ej 



0.75/ y Ej /GeV©0.03 respectively [9j. We select the events to contain isolated leptons/large 
fir and two jets with the following basic acceptance cuts 13 

Pt{£), PtU), fir > 15 GeV, \ m \ < 2, \ Vj \ < 3, 
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AR(Jj) > 0.7, AR(j£) > 0.5, AR(l£) > 0.3. 



(10) 



To quantify the signal observability, we must consider the SM backgrounds. The irreducible 
backgrounds are 

• W + 2 jets, Z + 2 jets with W, Z leptonic decays; 

• W + W~ , W ± Z, and ZZ with semi- leptonic decays; 

• single top production leading to W ± b q. 

With the basic cuts in Eq. (ITU1) . we list the cross sections of the signal with rriQ = 400 
GeV and S Q C = 1 for different channels and the leading SM backgrounds in the second 
column in Tables HT1 — IIVI The background from ti is relevant. However, with the cuts as 
described in Eqs. ffTUl) — ( TT2l and some additional cuts described below we can essentially 
eliminate the ti background. For the case of CC decay modes of the signal, we can impose 
a veto on a second isolated lepton (defined as Pt(£) > 15 GeV, \r}i\ < 2 and AR(j£) > 0.5) 
to reduce the ti background from the fully leptonic decay mode. For the NC decay mode 
of the signal with leptons in the final state, we can veto events with missing energy (ft 
x > 15 GeV). For the NC decay mode into neutrinos, we can veto events with any isolated 
leptons. The cross-section with the lepton/missing energy vetoes for the ti background are 
listed in parentheses in the second column of Tables [TT] — IIVI To further reduce ti events, 
we can veto events with b-tags (this has virtually no effect on our signal) and require that 
the two leptons reconstruct the Z boson for the NC signal. The semi-leptonic decay mode 
can be reduced further by vetoing events where any two jets reconstruct a W-boson or if 
any three jets reconstruct the top quark. Note that even with just the cuts in Eqs. ( JTUI) — 
( TT2|) and the simple vetoes which do not affect our signal significantly, the ti background is 
negligible compared to the leading background and even the signal. Hence we can justifiably 
neglect the ti background in our analysis. 

While the background cross sections can be large to begin with, it is important to notice 
the qualitative difference of the kinematics between the signal and backgrounds. First, one of 
the two jets is associated with W, Z t-channel exchange with a typical transverse momentum 
~ Mw/2. More importantly, the second jet is from the heavy quark decay that makes it very 
energetic with a Jacobian peak near pr(j) ~ |^q(1 — M^/itIq) 1 ^ 2 . Using the pr of the jets 
as a discriminant gives very good accuracy in identifying the correct jets, especially for high 
masses. Hence we identify the hardest jet (jVj as the one from heavy quark decay and the 
softer jet (j s ) as the one associated with W/Z i-channel exchange. Similarly, the W/Z from 
the heavy quark decays are also very energetic. We can thus design a larger cut on the 
hard jet and the reconstructed W/Z to separate the signal from the background. Next, we 
note that the pseudo-rapidity of the soft jet associated with W/Z t-channel exchange peaks 
at \i]j s \ ~ 2, leading to the forward jet tagging to enhance the signal over the backgrounds. 
The pseudo-rapidity distribution for the soft jet of both signal and backgrounds are shown 
in Fig. [2]^a). The W (Z) gauge boson from the heavy quark decay via the CC (NC) can 
be energetic depending on ttiq, leading to rather collimated final state leptons; while those 
leptons in the background still tend to be back-to-back. This is shown in Fig. [2](b) for the 
azimuthal angle separation between the leptons (pt(^) and^y) for CC. A similar distribution 
between £ + £~ is present for the NC channel with visible Z decays. Also, the di-jet separation 
for the signal is large, typically back-to-back; while that for the QCD background tends to 
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present a collinear singularity. In order to take advantage of these kinematical features we 
impose 



PT(jh) > ^m Q , p T (W/Z) > ^m Q , 

AR(jj) > 1.5, AR(j£) > 0.8, 0.5 < \r] js \ < 3.0. (11) 

In addition we use a mass based cut on the azimuthal angle of the leptons (pee) optimized 
for each mass. The results with these improved cuts are listed in the third column in Tables HT1 
— IIVI Of most importance is the reconstruction of the mass peak for the resonant particles. 
For a heavy quark decay with Z — > £ + £~ in the final state, it is straightforward to form 
the invariant mass for the heavy quark itlq = M(Z,jh), as shown in Fig. [2(c) for the signal 
and backgrounds. For the final state with W — > iv and Z — > uu, one can define a cluster 
transverse mass variable to be 



Mrp 



1 ~ (V 'ptw,z + M w,z + PT ]h ) - (PTW,Z + PTj h f 



Those distributions are plotted in Fig. 12(d). We suggest the following invariant mass cuts 

m Q - X -m Q < M T (j h W/Z) <m Q + 50 GeV, 
m Q - 30 GeV < M{j h Z) < m Q + 30 GeV. (12) 

The results with the above invariant mass cuts are listed in the last column in Tables [II] — 

ED 

Several remarks are in order. Firstly, it is very interesting to notice the possibility of 
identifying the electromagnetic charge of the heavy quark produced. Note that the forward 
(backward) distribution of the soft jet should be correlated with the heavy anti-quark (quark) 
production. Moreover, this can be used as an indication for down-type or up-type heavy 
quark production by specifying the electromagnetic charge of the lepton. For e.g., an event 
with a backward soft jet and a positive (negative) lepton would indicate production of U 
(D) heavy quark. Similarly, an event with a forward soft jet and a positive (negative) lepton 
would indicate production of D (U) heavy quark. Secondly, in our analysis we included a 
single mass window cut based on an assumed mass for the heavy quark. This is standard 
to optimize the signal significance. However, an experimental analysis would include several 
mass window cuts and the appropriate statistical dilution factor. Thirdly, we have presented 
a partonic analysis with detector effects included through smearing. To simulate a realistic 
experimental environment, one would need to include showering and hadronization effects as 
well as real detector simulation. We have checked the credibility of our partonic simulation 



by including showering (ISR and FSR) and hadronization using PYTHIA [ll[ and realistic 
detector effects using PGS [12] for itlq = 400 GeV for the CC channel and the results are 
presented in Table |V] In order to also estimate the effects of some reducible backgrounds, 
we have analyzed W+jet events with higher jet multiplicity (vetoing events with a third 
jet with px > 10 GeV to reduce backgrounds). We have estimated that the effect of such 
multi-jet backgrounds reduces the S/ \f~B from the partonic analysis by < 20% for vtlq = 400 
GeV in the CC channel. However, we expect that the more refined optimization techniques 
used in experiments, which are beyond the scope of this study, will be able to offset the 
above effects. 
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FIG. 2: (a) Top left: pseudo-rapidity distribution for the soft jet. (b) top right: azimuthal angle 
between prOO an d i>T (c) bottom left: invariant mass distribution for the reconstructed heavy 
quark from visible Z decay (d) bottom right: transverse mass distributions for the reconstructed 
heavy quark. 



We estimated the statistical significance for a signal near the assumed mass peak and 
analyse the full parameter space in the coupling parameter Sq C(NC) and ijiq plane. For 
an integrated luminosity of 4 and 8 fb _1 , we plot the 2a and 5cr contours in Fig. [3] for 
the CC decay mode and in Fig. H] for the NC decay mode. From Fig. [3] and Fig. HI we 
see that for itlq = 400 GeV, one would be able to reach a 5a discovery with 8 fb" 1 for 
S C D ° (S^ c ) w 0.2 (0.4) and Sq C(NC) w 1 for all other channels. We tabulate the achievable 
sensitivity in m,Q for Sq C ' = 1 (2) in Table IVII In these figures, the current bound from 
direct QQ searches at the Tevatron experiments is also indicated (the vertical lines). Given 
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TABLE V: Total cross-sections (in fb) for the signal with m,Q = 400 GeV and Sq C = 1 and the 
leading SM background at the Tevatron including showering and hadronization using PYTHIA 
and detector simulation using PGS. The corresponding significance from the partonic simulation 
is listed in the last column for comparison. 




' 200 



400 600 800 

m D (u) (GeV) 



1000 



FIG. 3: Sensitivity plots in the plane of model-dependent parameter Sq° and heavy quark mass 
nriQ for CC decay mode of heavy quark with 4 fb -1 and 8 fb -1 integrated luminosity. The top set 
(red) is for mjj versus S^} c and bottom set (black) is for mo versus Sp C . 



the rather weak signal for the single top production at the Tevatron, we do not expect the 
recent observations for this channel 13[ to improve the sensitivity on mq as presented in 
the figures. 



V. SUMMARY 



We have presented a simple setup with vector-like doublets that satisfies all experimental 
constraints and can occur naturally in models with warped extra dimensions. In our set-up, 
the heavy quarks can have sizable gauge couplings to valence quarks. This large coupling 
along with enhanced parton luminosity and distinctive kinematics makes single production 
competitive with and in fact better than QCD pair production, especially for large masses. 
While we are motivated by such a scenario, we have performed our analysis and presented 
our results in a completely model-independent manner. We have found significant sensitivity 
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FIG. 4: Sensitivity plots in the plane of model-dependent parameter Sq C and heavy quark mass 
vtiq for NC decay mode of heavy quark with 4 fb _1 and 8 fb _1 integrated luminosity. The top set 
(black) is for tub versus S^ c and bottom set (red) is for mjj versus . 



in the parameter space of uiq and the mo del- dependent coupling and branching ratio of the 
heavy quarks. With 4 (8) fb _1 , one may reach a 5a statistical significance for 580 (630) 



GeV for S C D C = 1 and 670 (710) GeV for S C D C = 2. According to Ref. |14j, a D quark with 
mass 640 (720) GeV and specific decay branching fractions can be discovered at 5a through 
pair production with ~ 5 (10) fb _1 data at the y^s = 14 TeV LHC There is also another 
study [l5[ that estimates the LHC (-y/i = 14 TeV) reach of heavy D quarks via single quark 
production in the context of an E 6 model for a specific choice of parameters. A charge 2/3 
quark with mass 500 GeV decaying into third generation SM quarks can be discovered at 



5a through pair production with ~ 3 — 7 fb _1 data at the \/s = 14 TeV LHC 16|. However, 
such bounds do not apply to our case where the quarks decay exclusively to first generation 
SM quarks. We have also suggested a method to effectively identify the electromagnetic 
charge of the produced heavy quark. In conclusion, we have investigated the potential to 
search for new heavy quarks at the Tevatron in a model-independent way and have found 
that the current sensitivity can be increased greatly in the context of the class of models 
presented by analysing the single quark production channel. Our study also shows that the 
Tevatron can probe an interesting class of extra-dimension models with this analysis. 
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APPENDIX A: EXPLICIT REALIZATION 

In this Appendix we describe in detail an explicit realization of a model with vector-like 
quarks that motivated the analysis in this paper. We will also comment on the features 
of five-dimensional models that make natural the apparent fine-tunings of four- dimensional 
models. The set-up is the SM extended with two vector-like quark SU (2) l doublets with 
hypercharges 1/6 and 7/6, denoted, respectively, by 

/ (0)u \ / (0)u \ 

n (o) _ / Ql,r \ Y (o) _ / X l ,r \ / Al x 

VL,R - (0 )d . L,R ~ (0 )d . i Ai ) 

\ Vl,/? / 1/6 \ Xl,r J 7/6 

where we have denoted the hypercharge with a subscript. Note that the new quarks have 
electric charges equal to 2/3 (for q u and x d ), — 1/3 (q d ) and 5/3 (x u ). We assume that these 
new vector-like quarks are exactly degenerate and couple (with identical strength) only to 
the up quark, in the basis in which all the SM flavor mixing occurs in the down sector. The 
Lagrangian reads in this basis 



C = C K - 



KIl ¥ u R + A d V ij<lL ¥ a R 

>(°)/s_l. v(o) n ,(o) _/n(o) n (o) , y-(0) v (o) 



+ \ Q {Qft> + Xr<p)u% + mQ{Qi, Qr + AT AT) + hx.j , (A2) 

where Ck = ^ipi^ is the sum of the diagonal kinetic terms (with covariant derivatives, thus 
including gauge couplings) for all the fields in the theory, i,j = 1,2,3 are family indices, 
Vij is a unitary matrix (the CKM matrix in the absence of new physics), (p is the SM Higgs 

field, (p = ia 2 ip* and with no generational index is the SM up quark. All fields have a 
superscript (0) to denote that they are not mass eigenstates. In order to extract the physics 
from this system, we need to go to the mass eigenstate basis, in which the mass Lagrangian 
is diagonal. Before doing that, we should notice that the charm and top quarks are already 
mass eigenstates. Furthermore, the charge —1/3 quark mass eigenstates are simply defined 
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in terms of the current eigenstates as 



v i3 u L ' 



d l R = d 



(0)i 
R ' 



Q d L,R 



J0)d 



(A3) 



Thus, the only non-trivial diagonalization comes from the mass Lagrangian involving the 
up quark (hereafter denoted simply by it, similarly from now on X u = A*) and the charge 
2/3 quarks in the new vector-like multiplets. This diagonalization is done in two steps, first 
there is a redefinition of the heavy fields, 



(o)± = J_( 9 (o)« ± x (o)<m 



Qlr 



V2 y 



(A4) 



so that the relevant part of the mass Lagrangian now reads, 

/ X„v \ 



C 



ii 



(o) -(o) 
Ql 



_(0)- 

Ql 



\ 



( ^ \ 



\p2\ Q v m Q 
m Q ) 

This matrix can be diagonalized with the following two rotations 



R 



(A5) 



■a 



(0) 
L,R 

(0)+ 



CL,R Sl,R 

sl,r cl 7 r 




(A6) 



where sl,r = sin 9 L R and cl,r = cos 6*^^. q L R = q L R is already a mass eigenstate with mass 
rriQ and does not need to be rotated. The rotations in Eq. (1A6|) can be computed exactly, but 



it is simpler to perturbatively expand the solution in the small parameter v/mq, as long as 
the relevant Yukawa couplings are at most order one, |A n |, |Aq| < 0(1) and the new quarks 
are relatively heavy as compared with the Higgs vev, v — 174 GeV, so that v/itlq 1. The 
result for the rotations is 



c l 

sr 
Cr 



-V2X U X Q ( — ] x 



-V2\ Q — x 



m Q 



\ m Q/ 

1 + A U A 



1 + (A* - 2\l 



v 



+ 



-) +■■ 

m Q J 



(A7) 
(A8) 



whereas the masses read, 



m Q 



1 + A 



+ 



(A9) 



In particular we see that we need to take X u ~ 1CT 5 in order to correctly reproduce the 
up quark mass. Note however that Aq can be order one without conflicting with the mass 
of the up quark. We will see below that an order one Aq is in fact also compatible with 
electroweak and flavor constraints. 

In the mass eigenstate basis, the gauge and Yukawa couplings are no longer diagonal and 
get corrections with respect to their original values. The fact that we have introduced new 
fields with non-SM gauge quantum numbers, like right-handed SU{2)l doublets, prevents 
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the GIM mechanism from protecting the gauge couplings in the physical basis. Similarly, 
the fact that the masses not only come from Yukawa couplings but also from direct Dirac 
masses lead to non-diagonal Yukawa interactions in the physical basis. We parametrize the 
new couplings in the physical basis as 



i.d 



9 



2cw 
9 

'V2 



~ ^lX^L + (L^R) + ...- 2s 2 v J ] 



EM 



<„, (A10) 

rilWial^aL + XW^r^L + (L —> R) + . . . W+ + h.C, (All) 



+ ^tiXi^R + . . . + h.c 



1 H 



(A12) 



where ip u ' d represent all the quarks with charges 2/3 and —1/3, respectively, the dots 
represent couplings that are not relevant for the phenomenology of these quarks and 
Jg M = Yl^^l^Q'^ 1S the electromagnetic current. We separate these couplings in two 
categories: 



• The couplings of light quarks: These have been experimentally observed and are 
strongly constrained by electroweak precision and flavor data. 

• The couplings involving one light and one heavy quark: These have not been discovered 
yet and they give the main production and decay mechanism for the processes we 
have considered in this article. They can be constrained by flavor data if large flavor 
violations are introduced. 

Recall that the mass mixing only involves the up quark. Thus only the up and some of the 
down quark couplings can be modified, whereas the ones of the s, c, b and t quarks remain 
as in the SM. Regarding the first category of couplings, we obtain 



X 



X. 



R 



o, 



cl 



0, Y: u = c R (X u c L + V2\ Q s L ) w X u 1 - 3X1^ 



1 - 2 A?, A; 



(- 

\m Q 



udi 




— > (A13) 



where the symbol ~ indicates that we have neglected higher orders in the v/ttiq expansion. 
We see that no new RH currents are introduced among the light quarks and that the LH 
gauge couplings get corrected at order (f/mg) 4 . Furthermore, these corrections have an 
extra suppression proportional to X\ ~ 1CT 10 and are therefore unobservable. Note that 
the correction to the up Yukawa coupling is still proportional to X u , with an additional 
suppression of Xq(v / 'mo) 2 , and is therefore negligible. The relevant couplings between a 
light quark and a new heavy quark read 



(A14) 





= V2W« d = V2W* U = 


s R -V2X0- 

r 


1 q+u 


= c R {-X u s L + V2Xqc l ) 


~ V2X Q 


X uq- 


= V2W^ qd = Vzw£u u = 


s L Ps -v^A^A 


Ji uq+ 


= s L c L w V^A^Aq 





V 
m Q 



(A15) 
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W q L +di = -V udi s L » V2V udt \ u \ Q — , (A16) 

\ m Q / 

O = -s*(A u c L + v^AqSl) « s/2\ u \ q — , (A17) 

= K-it = = K+ii = K- = K-u = o- (Ms) 

The couplings in Eq. f]A14|) correspond to the ones we study in this article plus a non- 
suppressed Yukawa coupling that we do not investigate in this article. The gauge couplings 
are of order v/itlq and have no \ u suppression but only a coefficient Aq or V2\q, which 
can be order one and corresponds, in this approximation, to the relevant k parameter in 
the main text. Similarly, the last coupling is a Yukawa coupling that is of order Aq. It 
can lead to potentially interesting signatures in Higgs physics that will be investigated in 
a future publication. The couplings in Eqs. (IA15[) and (IA16I) are all of order v 2 /rnq and 
have an extra \ u ~ suppression. The coupling in Eq. (1A16j) in particular is the only 
new source of flavor violation. The fact that it is suppressed by CKM angles and by X u 
ensures no conflict with flavor data, even for Aq ~ 1. The coupling in Eq. (1A17I) is a Yukawa 
coupling between q + and the up quark, but it is suppressed by one power of v/rrig and 
most importantly by the tiny up Yukawa X u ~ 10~ 5 and therefore has no phenomenological 
implications. Recall that there is another large Yukawa coupling between these two quarks 
that will be the main decay mode of q + . Finally the couplings in Eq. flA18j) are all identically 
zero. This analysis shows how one can have a scenario with large couplings of the up quark 
to new vector-like quarks without conflicting with current experimental data. A similar 
analysis could have been done for the down quark by adding two degenerate doublets with 
the right hypercharges (1/6 and —5/6). 

From the point of view of the four- dimensional model, however, there are a number of 
features that seem fine-tuned. In particular, we have introduced two exactly degenerate 
doublets with identical couplings to the SM quarks. We have assumed a large Yukawa 
coupling, Aq ~ 1, between the new quarks and the up quark, which itself has a tiny Yukawa 

coupling X u ~ 1CT 5 . Also, we have set to zero a Yukawa coupling between Qj/ and oIr, which 
is, a priori, not forbidden by any symmetry. Finally, we have forbidden intergenerational 
mixing. However, as we said in the main text, all these features can appear naturally in 
models with extra dimensions. For instance, degenerate bidoublets can appear naturally in 
models with custodial symmetry due to the fact that the two doublets are part of a gauge 
multiplet of the higher- dimensional symmetry. Another important property of the models 
with extra dimensions we are interested in is that not all Yukawa couplings that are allowed 
by the low energy (Standard Model) gauge symmetries are actually allowed by the higher 
dimensional gauge symmetries. In particular there is a class of models in which there are 
only Yukawa couplings between a particular SM fermion and its "own vector-like quarks" 
(that correspond to its Kaluza-Klein excitations). This could explain why there is a Yukawa 
coupling with the up but not with the down quark, for instance. 

A final important point from a model-building perspective is the large difference in the size 
of the two Yukawas A Uj q, which can be easily understood from the structure of the Yukawas 
of the higher dimensional multiplets. Let us exemplify it in a simplified four- dimensional 
model that simulates the extra-dimensional set-up. Assume we have the matter content we 
have considered so far, the SM quarks plus two vector-like doublets with hypercharges 7/6 
and 1/6, respectively, plus a vector-like singlet Ul,r with hypercharge 2/3 (same quantum 
numbers as the SM ur quark). Assume the two doublets and the ur live in the same 
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higher dimensional multiplet and therefore they have Yukawa couplings among themselves. 
Similarly, the new singlet is in the same multiplet as qi and therefore it only has Yukawa 
couplings with it. Finally, ur and Ul have the same quantum numbers and therefore can 
have a direct Dirac mass coupling them (for simplicity, we will also assume that the allowed 
Dirac mass coupling and q\ is vanishing). The resulting mass matrix Lagrangian reads 



/ 



C 



r M -(0)u (0)d MO) 

u l 11 al u l 



X u v 



\ 



X Q v m Q 
\ Q v m Q 
^ m\ ui2 j 



I „<?) \ 



U R 



(0) 



+ h.c. 



(A19) 



Note that this mass matrix is non-diagonal even in the absence of electroweak symmetry 
breaking {i.e. v = 0). In order to obtain a diagonal matrix in the absence of electroweak 
symmetry breaking, we perform the following rotation, 



u 



(0) 
R 

(0) 




U 



with So/ Co = sin#o/ cos#o = -mj/m2. In that case the mass Lagrangian reads, 



(A20) 



C 



(0) 



_(0)u 

Tl 



_(0)<i 

Xl 



U 



(0) 








c \ u v ^ 


( ^ 


coXqv 


m Q 


-s \qv 




C XqV 


m Q 


SqXqV 




V 





m 2 /co J 


\ US' j 



+ h.c. 



(A21) 



If UI2/C0 is much larger than uiq, the effects of the singlet can be safely neglected and we 
just have to look at the 3x3 submatrix involving the SM quarks and the two doublets. In 
that case, we recover our original Lagrangian, Eq. (1A2|) . with the identifications 



X u — SoX u , Xq — CqXq. 



(A22) 



Thus, starting with all Yukawa couplings order one, X u ~ Xq ~ 1, we see that X u ~ 1CT 5 
requires Sq ~ and therefore Xq ~ Xq ~ 1. Note that if the up quark was heavier (or for 
heavier generations), then it is not necessary that so be this small, in which case cq would 
have been smaller resulting in the coupling Xq being smaller as well. Thus, in this class of 
constructions which can naturally appear in models with extra dimensions, the coupling Xq 
is large, precisely because the up quark is so light. 

An example of these features is the model in Ref. [2J. This model was constructed with 
electroweak symmetry breaking in mind, which only involves third generation quarks. It 
has however all the ingredients to realize the set-up we study in this paper. There are light 
Kaluza-Klein excitations of five-dimensional quarks (which are vector-like), with masses in 
the range 300 — 500 GeV, that come in degenerate doublets with hypercharges 7/6 and 1/6. 
As we mentioned, they are degenerate because they belong to the same multiplet of a higher 
symmetry, a bidoublet of SO (4), and have the same boundary conditions. Furthermore, 
the two degenerate doublets and live in different five-dimensional multiplets, whereas 
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u R lives in a superposition of both explaining that Xq (i.e. the corresponding k) is large, 
precisely because the up quark is so light (X u so small). Finally, although flavor issues were 
not discussed in that reference, the flavor constraints in warped models [l7|, require some sort 
of flavor symmetry protection [l8| that could easily explain why intergenerational mixing is 
forbidden. As an example, one point for the model studied in Ref. [2[ gives mjj = vtld = 480 
GeV and k u n = 0.57, h u jj = 0.81. The fact that all these ingredients can naturally appear 
in successful models of electroweak symmetry breaking has motivated us to perform this 
study. 
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